Only Aggressive Elephants are Fast Elephants
نویسندگان
چکیده
Yellow elephants are slow. A major reason is that they consume their inputs entirely before responding to an elephant rider’s orders. Some clever riders have trained their yellow elephants to only consume parts of the inputs before responding. However, the teaching time to make an elephant do that is high. So high that the teaching lessons often do not pay off. We take a different approach. We make elephants aggressive; only this will make them very fast. We propose HAIL (Hadoop Aggressive Indexing Library), an enhancement of HDFS and Hadoop MapReduce that dramatically improves runtimes of several classes of MapReduce jobs. HAIL changes the upload pipeline of HDFS in order to create different clustered indexes on each data block replica. An interesting feature of HAIL is that we typically create a win-win situation: we improve both data upload to HDFS and the runtime of the actual Hadoop MapReduce job. In terms of data upload, HAIL improves over HDFS by up to 60% with the default replication factor of three. In terms of query execution, we demonstrate that HAIL runs up to 68x faster than Hadoop. In our experiments, we use six clusters including physical and EC2 clusters of up to 100 nodes. A series of scalability experiments also demonstrates the superiority of HAIL.
منابع مشابه
Wild Asian elephants distinguish aggressive tiger and leopard growls according to perceived danger.
Prey species exhibit antipredator behaviours such as alertness, aggression and flight, among others, in response to predators. The nature of this response is variable, with animals reacting more strongly in situations of increased vulnerability. Our research described here is the first formal study to investigate night-time antipredator behaviour in any species of elephants, Asian or African. W...
متن کاملElephants avoid costly mountaineering
Understanding the behavioural decisions underlying animal movements is a major challenge. Here we report evidence for the importance of the abiotic terrain feature 'gradient' in guiding the movements of African savannah elephants (Loxodonta africana). Global Positioning System (GPS) tracking data overlaid onto digital elevation and surface gradient models show that elephants tend to avoid steep...
متن کاملLongitudinal study of Asian elephants, Elephas maximus, indicates intermittent shedding of elephant endotheliotropic herpesvirus 1 during pregnancy
INTRODUCTION EEHV-1 is a viral infection of elephants that has been associated with a fatal haemorrhagic syndrome in Asian elephants. Previous studies have suggested that pregnant animals may shed more virus than non-pregnant animals. METHODS This study examined whether pregnancy affected the frequency or magnitude of shedding of elephant endotheliotropic herpesvirus 1 (EEHV1) using Taq man r...
متن کاملWhy Elephants Gallop: Assessing and Predicting Organizational Performance in Federal Agencies
'In a recent article published in this journal, the authors argued that elephants and public organizations have something in common. Both are saddled with inaccurate stereotypes. Elephants are believed to be slow and insensitive creatures, when in fact they can run very fast and are very sensitive. Similarly, public organizations are believed to be low-performing and unresponsive, when in fact ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- PVLDB
دوره 5 شماره
صفحات -
تاریخ انتشار 2012